@dankcushions Hey, thanks. That worked perfectly, thank you!
Just in case anyone comes across this later this is what I did:
the "Load content specific core" option is enabled by default. Start your game, open the retroarch menu, then select Quick Menu > Options > Create Game options file. Exit the game. Once you do this a file should be generated in /opt/retropie/configs/all/retroarch/config/PCSX-ReARMed, or \retropie\configs\all\retroarch\config\PCSX-ReARMed on the network, called something.opt. Open this and set the plugin to disabled.